Constrained robust Bayesian optimization of expensive noisy black?box functions with guaranteed regret bounds
نویسندگان
چکیده
Many real-world design problems involve optimization of expensive black-box functions. Bayesian (BO) is a promising approach for solving such challenging using probabilistic surrogate models to systematically tradeoff between exploitation and exploration the space. Although BO often applied unconstrained problems, it has recently been extended constrained setting. Current methods, however, cannot identify solutions that are robust unavoidable uncertainties. In this article, we propose method, adversarially (CARBO), addresses challenge by jointly modeling effect variables uncertainties on unknown Using exact penalty functions, establish bound number CARBO iterations required find near-global solution provide rigorous proof convergence. The advantages demonstrated two case studies including non-convex benchmark problem realistic bubble column reactor problem.
منابع مشابه
Constrained Bayesian Optimization with Noisy Experiments
Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems, including Internet services. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error. Bayesian optimization is a promising technique for optimizing multiple continuous parameters for field experiments, but existin...
متن کاملParallel Bayesian Global Optimization of Expensive Functions
We consider parallel global optimization of derivative-free expensive-to-evaluate functions, and proposes an efficient method based on stochastic approximation for implementing a conceptual Bayesian optimization algorithm proposed by [10]. To accomplish this, we use infinitessimal perturbation analysis (IPA) to construct a stochastic gradient estimator and show that this estimator is unbiased.
متن کاملBayesian Optimization with Expensive Integrands
We propose a Bayesian optimization algorithm for objective functions that are sums or integrals of expensive-to-evaluate functions, allowing noisy evaluations. These objective functions arise in multi-task Bayesian optimization for tuning machine learning hyperparameters, optimization via simulation, and sequential design of experiments with random environmental conditions. Our method is averag...
متن کاملLower Bounds on Regret for Noisy Gaussian Process Bandit Optimization
In this paper, we consider the problem of sequentially optimizing a black-box function f based on noisy samples and bandit feedback. We assume that f is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert space (RKHS), yielding a commonly-considered non-Bayesian form of Gaussian process bandit optimization. We provide algorithm-independent lower bounds on the simple ...
متن کاملBlackbox: A procedure for parallel optimization of expensive black-box functions
This note provides a description of a procedure that is designed to efficiently optimize expensive black-box functions. It uses the response surface methodology by incorporating radial basis functions as the response model. A simple method based on a Latin hypercube is used for initial sampling. A modified version of CORS algorithm with space rescaling is used for the subsequent sampling. The p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Aiche Journal
سال: 2022
ISSN: ['1547-5905', '0001-1541']
DOI: https://doi.org/10.1002/aic.17857